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A UNIT ON EFFECTIVE THINKING, WITH THE EXPERIMENTAL 
FOCUS ON INFLUENTIAL THINKING, WAS PREPARED AND TESTED. A 
TEXT, -EFFECTIVE THINKING,- WAS PREPARED. AN INEXPERIENCED 
TEACHER USED THE TEXT IN A NINE WEEK COURSE WITH SEVENTH 
GRADE STUDENTS. ONLY A POST-TEST CONTROL GROUP DESIGN WAS 
USED. THE TWO FACTORS STUDIED WERE TREATMENT AND SEX. THE 
TEST OF INFERENCE PATTERNS (TIP), USED BY HOWELL IN AN 
EARLIER STUDY, WAS THE CRITERION MEASURE AT THE END OF THE 
FIRST NINE WEEK PERIOD. STUDENT IQ'S WERE ALSO AVAILABLE. THE 
INFERENTIAL REASONING ANLYSIS (IRA) BY HOWELL WAS THE 
CRITERION MEASURE USED FOR THE SECOND NINE WEEK PERIOD. 
ANALYSIS OF VARIANCE OF TOTAL TEST SCORES ON TIP YIELDED 
SIGNIFICANT DIFFERENCES BETWEEN THE EXPERIMENTAL AND CONTROL 
GROUPS. THERE WAS NO SIGNIFICANT DIFFERENCE BETWEEN THE 
SCORES OF MALE AND FEMALE STUDENTS OR BETWEEN TREATMENT AND 
SEX. USING A COVARIANCE ADJUSTMENT, IT WAS FOUND THAT IQ HAD 
AN EFFECT ON THE CRITERIO; . ANALYSIS OF VARIANCE OF PART I, 
lit IV, AND TOTAL SCORES OF THE IRA PRODUCED SIGNIFICANTLY 
HIGHER SCORES FOR THE EXPERIMENTAL GROUP. SIGNIFICANT 
DIFFERENCES WERE FOUND BETWEEN THE SEXES FOR TOTAL IRA 
SCORES. NO SIGNIFICANT INTERACTION WAS FOUND BETWEEN 
TREATMENT AND SEX. IN GENERAL, RESULTS INDICATED THAT SEVENTH 
GRADERS CAN PROFIT FROM INSTRUCTION IN INFERENTIAL REASONING, 
AND THAT HIGHER IQ STUDENTS WILL PROFIT MORE FROM THIS 
INSTRUCTION. (SK) 
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INTRODUCTION 

o,w„^ feCtiVe thinki , ng is ssnewilly desired as an outcome of the 
bten rated P or«n S: development of the ability to think has 

by the Educatioml^p^-,' 0 '^ American secondary education 

^sVcLtien VT ^ iCleS Ccmmissi on of the Motional Education 

11 1 ”*? expiosxve production of new subject natter, 

has effected", SC1 f noe and mathematics, during the last few decades 
to master Vet a J m0St . overwhelming burden of content for students 
ouoht'n^'b/d*' t0 think and mastering subject content 

ture of n !^K^ t C ? lly c P posed ’ 0nce the fundamental struc- 

sucJl as tIie undefined terms and postulates in 

thiriSn^to'd^ learned ' there is a Clear need for effective 
to discover and prove propositions inferred by the 

d° nS 't Muc h classrocm activity is devoted to the presenta- 
' a " d mastery of content. Effective thinking is usually a by- 

£ iS gene “ Uy l“™ad 9 irnplicmy and Lt 

-TrZZ L : 3 r ;; P robiem «as to determine whether 

-ertaxn aspects of effective thinking could be successfully 

^a...ea xn a axrect manner as early es the sevenrh exude. 

w , an seventh-grade curriculum at Hudson Junior High School in 

. ® " S1 ? has in cluded a daxly period for student exploration 

nlI^tSt CS introduced into the standard courses. This ex- 
P . . program was divided into four parts: speech, art, logic 

took ei each r ^ n thff rial edUCati ° n ° r h * e Panics! All students 
tion w 0 "” 68 With b0yS taking industrial educa- 

weeks dumiion ^ n9 1 h ° me eco “°mics. Each course was of nine 

i oglc course has been the center of discus- 
” , j , ls report, for it represented an attempt to teach 

l^f thL r t0 Q c ri r at Me ii” teas oned conclusions to the prob- 
QCe ; Such conclusions could be attained if the P 

ll ttTZ, kne ” h f' tQ , thin5c clea rly, to separate fact from opinion, 
and iS- ? nd luat ® Propaganda, and to reason deductively 
and xnductxvely. These desirable student behaviors represented 
correlates to the objectives of the logic course. represented 

year cent SA* the firSt time during the 1964-5 school 

y 0 c ° n \ ent fox the course was selected from standard 

^hf*! e3 V tb0< *f °w logic ' £or these were the only sources known 
tio^l S * ° V Qt tim f- The vocabulary was laden with tradi- 

19V? l H^Sl f-T clQ f ’ lcal logic. In the Spring and Fall of 

5, Howell [/] was invited to study whether the logic course as 

Prepared the students to correctly identify valid ' 

aSis S H Eel6Cted infe rence patterns (cf. Appendix A). 

Analysxs of the experxmental data justified the assertion that the 

satisfactf> Se ^ PIWiAe ° “ edi ™ ^ transfVr to 

Vhls f O, y oohrevoment in inferential reasoning. The teacher of 

thxs course realised that the materials chosen for use werV nit 
bexng understood by the students. These evaluations pointed to 
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~>oni“Mu“ , 3“n«5ns i s x« !r?rs.°” ”" 

s* “ 

self-cwWrurtK^rf control groups when measured by a 
sions were that correct th^v-* ”? abi iity. Hyram's major conclu- 
of the prfnclnLs ? 9 l* “ funCtion <* one's knowleage 

tional un!“ In 5R “ lo 9 lcall y b V “«>"* * instruc- 
Mqw [13] investioated uh«fJtr>r •; - 

tL“ir“::r;i “- auprjer - middle suburb ““ neighborhood! Io£d w we 

i ‘“5 Cr “ icaJ - rm. racing abilities under instructor, cu. i” P ? 

5?S SS^SiSISr “ 'S» 

were effective in iff i lhil *? n 9* she concluaea that the lessors 
instr»en?! “*Prcvmg those thinking skills testea in her 

ana 10°tt e IchiLe t wen d te k < ^ Uitl, . Cf stuaents of grades 6, 7, 8, 
reachina aeneraJ ' ^ th ln an lntroduc tion to methods of 

tive geometry, ^e i ntroduction to demonstra- 

apply the me&oaf T a‘ 9 1?* StUdents were to 

reasoning moderately well in botv," ” cti '[ e . reas oning, and deductive 
situations it? Jfll iV" b0th 3e«netric and non-geometric 

during the siw*h f t ^“ t this ubili ty advanced rapidly 

to tenth grades! 6n lnCreased slwi y from the seventh 

an accSStidlath^^ Mhether juni ° r hi 9 h school students i„ 
sions^ ° OUld rec ° 3 ni 2 e correct conclu- 

no formal trai^ing o foaic ****?* ev ®J ? hou 9 b they had received 

in inferential^ i“ tbe h «?otheses that growth 

logic improves wl V Mlth ° Ut foraal instruction in 
ability favors neither sex H 9 I ad ® level and tht,t this 

rsis £ * sr 

-is^^.»rSS£A"S22.* ,lto 

introductions and that the nf e + ? n a , S0 pattern called and- 

*— «> ~u « - Sf 
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The preceding study indicated that junior high school 
students of above-average ability in mathematics learn inference 
patterns at a progressive but slow rate without formal instruc- 
tion. The other studies indicated that students of grades 6, 7, 
and 8 .can learn elementary aspects of effective thinking with 
formal instruction. The question arose as to what extent all 
seventh-grade students could profit from explicit instruction in 
inference patterns. Therefore, another purpose of this investiga- 
tion was to determine experimentally whether seventh-grade 

students could profit from instruction in patterns of inferential 
reasoning. 

The objectives of this study were to: (1) prepare a textbook 

on effective thinking which contained a unit on inference patterns 
(2.) select or prepare a suitable instrument to measure ability to 
reason inf erentially, and (3) establish an experimental situation 
to test student ability to reason inferential ly. 



METHOD 

The method section of this report has been divided into three 
parts to match the foregoing objectives. They are: (1) the text, 

(2.) the tests, and (3) the experimental procedure. 

A. The Text. 

The initial phase of the text preparation involved the 
establishment of a definition of effective thinking. Several were 
examined for suitability and similarity. The writing team 
selected that proposed by Ennis [3] in which he equated critical 
(or effective) thinking with the correct assessing of statements. 
This implied the need for a thorough examination of each statement 
and of the entire set of statements leading to the conclusion. 
Hence the text. Effective Thinking [8], was subdivided into two 
major parts: statements, and reasoning. The chapters of the 

first part dealt with observation, authority, and statement errors j 
those of the second part concerned inductive, deductive, and 
faulty reasoning, ' 

The text was prepared during June, July, and August of 1967 
by „ a „ wr j t i ng team consisting of Edgar N. Howell, Elmer A. Mellum, 
and Noel Schumacher. Dr. Howell was an associate professor of 
mathematics and mathematics- education at Wisconsin State Univer- 
sity at River Palls. Mr. Mellum was the seventh-grade science 
teacher at Hudson Junior High School. Mr, Schumacher was the 
principal of Hudson Junior High School and had taught social 
studies prior to assuming his administrative post. Delphine 
Johnson, language-arts teacher at Hudson Junior High School, 
helped with +he final revision of the text. 



One of the important guidelines in the preparation of this 
material was that of restraining the selection of terras and the 
style of writing to the level af the student. To adjust for the 
almost practical impossibility of achieving this, it was assumed 
that the teacher of the logic course would inherit the responsi- 
bility of guiding the students through the more difficult parts. 

A copy of Effective Thinking has been submitted with this 
final report, 

B, The Tests. 

A search of the usual commercial sources revealed a lack of 
standardized tests of reasoning ability appropriate for use with 
seventh-grade students. Therefore, two locally devised instru- 
ments were used as measures in the experiment. The first was a 
scale called Test of Inference Patterns, which has been 
frequently abbreviated TIP throughout this report. The second 
was named Inferential Reasoning Analysis and abbreviated IRA. A 
copy af Test of Inference Patterns has been placed in Appendix B, 

while a copy of Inferential Reasoning Analysis has been placed in 
Appendix C. 

TIP was a revision of Test of Selected Inference Patterns, a 
copyrighted instrument prepared by Howell for use in his doctoral 
dissertation [6],.. TIP was designed for and employed first in at 
previous experiment [7] at Hudson Junior High School. Eight 
valid and two invalid inference patterns were chosen for use in 
TIP$ they have been listed in Appendix A. The test was divided 
into two parts: in the first, the patterns were presented in 

statement forra^ in the second, the statements were replaced by 
capital letters. Within each part there were three occurrences 
of each pattern. Numbering of the exercises was done randomly. 
The assignment of either a correct or an incorrect response to 
each valid exercise was made at random. Although the invalid 
patterns could not require a unique response, the choice of an 
apparently correct or incorrect response was made randomly. 

Since valid and invalid inference patterns were intermingled 
in TIP, it was conjectured that student learning of the valid 
patterns might be more accurately displayed on a test which con- 
tained valid patterns only at the beginning. Therefore, in 
December 1966, the project director prepared a new instrument. 
Reasoning Analysis, which consisted of four parts. 
Parts I and II were similar to those of TIP, except that they 
lacked examples af three patterns used in TIP, viz., not- 
introduction, converse pattern, and inverse pattern,. Not- 
introduction, although valid, was deleted from IRA because the 
students were not taught this pattern and because it was not 
explained in Effective Thinking . However, four examples of each 
of the seven valid inference patterns occurred in each of the 
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firrt two parts of IRA, Part III contained ten exercises, each 
requiring the use of two valid inference patterns to achieve a 
complete correct response, r'ive possible responses were assigned 

° nly two 05 these were correct and one used more 
information from the premisses than the other. The 'more correct' 

response was allotted two points, the other one point. Part IV 

. i * Ve ? xam Pl es ff the invalid patterns mixed randomly 

with five examples of valid ones • 

C* The Experimental Procedure. 

Jmrt the 1966-7 seventh-grade class at Hudson 

.. c °°^ were red to take the logic course. Pour 

sections were to be formed, and one section 

”!~ d l0 ?fw per ?“ r ! er - Therefore, only one experimental 

anotw !« C ? d<i be ^V~t A during that quarter on one section and 

nlrfM. 'T ” OUld b ® available as a control. To minimize 
possible reactive arrangements and to avoid the loss of an 

^!! UC - 10naX period ' it was decided not to give a pretest. Under 
^!!/i rCUmStanceS the posttest-only control group design [l] was 
3Wy=d tne most appropriate ror the experiment. Since a different 
section would be taking logic during the second -carter ±+ uns 
decided to conduct the experiment twice, the second'one'being a 
iu edification rather than a replication of the first. 

P 16 admirdstrotion and faculty desired to have heterogeneous 

g arping within all sections of the seventh grade. To achieve 

? y “ ad devised a ranking procedure whereby each student was 
assigned a composite score based upon the following criteria: (1) 

his score on the Otis Quick-Scoring Mental Ability Tests, Form A , ' 
given in the fourth grade, (2) his score on the Iowa Tests of 

kllls 9 iven during the last month of the sixth grade, and 
(3 his score on a five-point scale of sixth-grade classroom 
f’® r !° ra ? nc ? evaluated by his teacher. Students were then ranked 

Grams ** these ' Composite scares, starting with the highest. 

Groups of four were then formed. Within each of these groups, 

Stude^ were assigned randomly to the exploratory sections! 

sectfn^ f-oeking a complete set of scores were assigned to the 
sections m a completely random manner. 

. , °" e 5^ r he four exploratory sections was chosen at random to 

couJ !w glC C ° UrSe durin 9 the quarter; this secUontas 

th ® experimental group for that quarter. Another section 

most of S! e<i f a " domly . to be the control group for that quarter; 

• * ° f v h ? Students ln this section took the exploratory course 

to ™n e tL dUrln9 : thS fiXSt nine " week period. Since it wls decided 

chosen tMlce ' one J of the ^ remaining sections was 

otbo- to fake the logic course during the second quarter. The 

its stwd^i 0 "*^™ 0 the contro1 group for that quarter; most of 
its students took art at that time. 
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Three weeks of the quarter were allotted for instruction on 
deduction* Thus 15 class periods, each of 42-rainute duration, 
were available to the teacher for presentation and testing on 
syllogisms, inference patterns, and proof. 

At the end of the first quarter TIP was administered to both 
treatment groups. IRA was administered to the remaining sections 
at the close of the second quarter in mid-January of 1967. 

To increase the power of the significance test [l], analysis 
of covariance was chosen for the statistical examination of the 
experimental data. The Lorge- Thorndike Intelligence Tests [10,11], 
both verbal and nonverbal batteries, were selected as cova^iate 
measures. These tests were considered appropriate for this 
purpose both because the authors had designed these instruments to 
measure reasoning ability and because they have been found to be 
good indices of scholastic aptitude [12]. The nonverbal battery 
[11] was used separately from the verbal battery [10] as a 
covariate to determine whether there would be different effects on 
the criteria since at least one-tenth of the seventh-grade 
students were receiving remedial reading instruction. 

Student auuKs on tne verbal and nonverbal batteries of the 
Lorge- Thorndike Intelligence Tests and on all parts and totals of 
both TIP and IRA were first examined by analysis of variance so 
that changes due to the covariance adjustment could be observed. 

A 2x2 factorial design was chosen with factors of treatment and 
sex. The two levels of treatment were experimental and control? 
those of sex were male and female. Since the cell frequencies 
were not expected to be equal under the sampling technique, the 
analyses of variance arid covariance were performed by the method 
of unweighted means [ 14] • The 5% level of significance was chosen 
for all statistical tests in this experiment. 

To determine the degree of association between the indepen- 
dent variable? (treatment and sex) and the dependent variable (IQ 
or TIP or IRA), omega-squared [5] was calculated for each obtained 
P- ratio in the analyses of variance and covariance. 

Several post hoc tests were performed* The reliability 
coefficients of TIP and IRA for both the experimental and control 
groups were determined by the split-half method with correction 
for attenuation [4] • Correlation coefficients [4] were calculated 
for all pairs of scales and subscales used in the experiment. 

These were tested for significance from zero and for significance 
between treatment groups. To determine which inference patterns 
were understood by treatment groups and subgroups, the proportion 
of students correctly responding to five or six occurrences of 
each pattern on TIP and to six or seven or eight on IRA were 
computed. Selected pairs of these proportions were examined for 
significant differences [4] between contrasting groups. 
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RESULTS 



The results from all analyses of the data collected during 
the first experiment have been reported in their entirety* 
Following this, the results from the second experiment have been 
reported in their entirety* 

The F- rati os and estimated omegas- squared from the analyses 
of variance and covariance of the tests used in the first experi- 
ment have been tabulated in Table 1* The summary statistics, 
test for homogeneity of variance, and summary tables for the 
analyses of vc.riance and covariance which form the basis for 
Table 1 have been placed in Appendix D, Tables 13 through 16* 
Bartlett's test for the homogeneity of variance [14] failed to 
reveal any significant differences among cell variances for the 
five seal ss or subscales involved in the first experiment. 

The results of the analyses of variance and covariance in the 
first experiment led to the rejection of the null hypotheses of no 
significant differences between: 

1) treatment means on Part II of TIP, 

2) treatment means on Part II of TIP when adjusted by the 

verbal battery scores on the Lorge- Thorndike test, 

3) treatment means on Part II of TIP when adjusted by the 

nonverbal battery scores on the Lorge- Thorndike test, 

4) treatment means of TIP, 

5) treatment means of TIP when adjusted by the verbal 

battery scores on the Lorge- Thorndike test, and 

6) treatment means of TIP when adjusted by the nonverbal 

battery scores on the Lorge- Thorndike test* 

The null hypothesis for no interaction between treatment and 
sex on the verbal battery of the Lorge- Thorndike Intelligence 
Tests was also rejected*. 

The degree of association between independent variables and 
dependent variables were insignificant except for the treatment 
effect measured by Part II of TIP and the total score of TIP. 

Both F- rati os and omegas- squared for the Part II scores on 
TIP and the total scores on TIP increased under the covariance 
adjustments for intelligence quotients whether verbal or nonverbal. 
However, the increase was larger when the verbal battery scores 
were used as the covariate* 
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TABLE 1. F- RATI OS AND ESTIMATED OMEGAS- SQUARED FROM THE ANALYSES 
OF VARIANCE AND OF COVARIANCE IN THE FIRST EXPERIMENT. 



v 
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• Variable 
• 


> 


Source af Variation 
+ • 




Covariate 


Criterion 


Treatment 


i 

} 

Sex 


ft 

ft 

i Interaction 






F 


O 2 


F 


O 2 


i - 

\ 


02 




LT-V 


.56 


.00 


.07 


.00 


I 

4.29 


.00 




LT-NV 


.00 


.00 


.09 


.00 


.97 


.00 




TIP- 1 


1.90 


.01 


.00 


.00 : 


.32 


.00 


LT-V 


TIP- 1 


3.64 


.03 


.00 


.00 


.15 


.00 


LT-NV 


TIP- 1 


2.17 


• 02 


.00 


.00 


.06 


.00 




TIP- II 


11.07 


•12 


• 16 


.00 


•22 


.00 


LT-V 


TIP- II 


16.30 


.17 


.34 


.00 


.22 


.00 


LT-NV 


TIP- II 


13.86 


.14 


•36 


.00 


.00 


.00 




TIP-T 


8.86 


.09 


.05 


.00 


.36 


.00 


LT-V 


TIP-T 


15.46 


.16 


.20 


.00 


.30 


.00 


LT-NV 

1 


TIP-T 


11.52 


.12 


.19 


.00 

i 


.02 


.00 



F(l,75) = 3.97 at the 5*0% level af significance 

F(l / 75) = 6.98 at the 1.0% level of significance 

F(l,75) = 11.79 at the 0.1% level of significance 

LT-V = Lorge- Thorndike Intelligence Tests, Verbal Battery 
LT-NV = Lorge- Thorndike Intelligence Tests, Nonverbal Battery 

TIP- 1 = Test of Inference Patterns, Part I 

TIP- II = Test of Inference Patterns, Part II 
TIP-T = Test af Inference Patterns, Total Test 



Tftie reliability af TIP if or the 40 students in the experi- 
mental group and that for the same number in the control group 
were calculated by the split- half method and corrected by use 
of the Spearman-Brown Prophecy Formula, The ob coined reliabil- 
ity coefficients have been tabulated in Table 2. 



TABLE 2, SPLIT-HALF RELIABILITY COEFFICIENTS 01 FOR THE TEST OF 
INFERENCE PATTERNS. 



Test of Inference Patterns 


Experimental 


Control 


Part I 


.45 


,29 


Part II 


.75 


.13 


Total 


.78 


.11 



Coefficients have been attenuated by use of the Spearman-B rcwn 
Prophecy Formula . 



Since reliability coefficients obtained by the split-half 
method were product-moment correlation coefficients, they could 
be tested for significance of difference from zero. Those for 

the control group were found to be not significantly different 
from zero. 

Correlations have been calculated separately for the treat- 
ment groups on all pairs of the following scales: Lorge- Thorndike 

Intelligence Tests, Verbal Battery; Lorge- Thorndike Intelligence 
Tests, Nonverbal Battery; TIP - Part I; TIP - Part II; and TIP - 
Total Test, The correlation coefficients for the experimental 
group have been placed in Table 3, while those for the control 
group have been placed in Table 4. 

All correlation coefficients for the experimental group were 
found to be significantly different from zero. However, for the 
control group the following correlation coefficients were found 
to be not significantly different from zero: those between the 

Lorge-Thorndike nonverbal battery and each of the three sets of 
scores on TIP, that between Parts I and II of TIP, and that 
between the Lorge-Thorndike verbal battery and Part II of TIP. 
Parts I and II of TIP were observed to be measuring different 
characteristics because at most 31% of the variance of one was 
accounted for by the other. 
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TABLE 3 V MATRIX OP CORRELATION COEFFICIENTS^ ON THE INDICATED 
VARIABLES FOR THE EXPERIMENTAL GROUP IN THE PIRST EXPERIMENT* 



i 



• 


LT-V 


LT-NV 


TIP-I 


TIP- II 


TIP-T 


Lorge- Thorndike 
Verbal 


1.00 


.65 


.54 


.58 


.64 


Lorge- Thorndike 
Nonverbal 




1.00 


.54 


<53 


.60 


Test of Inf* Pat, 
Part I 






1.00 


.55 


.82 


Test of Inf* Pat. 
Part II 








1.00 


• 

VO 


Test of Inf* Pat. 
Total 










1.00 



For df — 38, r > *312 is required for significance f ran zero at 
the 5 % level* 



TABLE 4. MATRIX OP CORRELATION COEFFICIENTS^ ON THE INDICATED 
VARIABLES FOR THE CONTROL GROUP IN THE FIRST EXPERIMENT, 





LT-V 


LT-NV 


TIP-I 


TIP- II 


TIP-T 


Lorge- Thorndike 
Verbal 


1.00 


.59 


.35 


.26 


.39 


Lorge- Thorndike 
Nonverbal 




1.00 


.02 


.29 


,23 


Test af Inf. Fat. 
Part I 






1.00 


.17 


.70 


Test of Inf. Pat. 
Part II 








lwQO 


.82- 


Test of Inf. Pat. 
Total 










1.00 



For df = 38, r > *312 is required for significance from . >ro at 
the 5% level* 
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The corresponding correlation coefficients for the treatment 
groups were tested for significance of difference for independent 
samples. The resulting at-scores have been placed in Table 5, At 
the 5% level c£ significance only two z-scores were found to be 
significant: that for the Lorge- Thorndike nonverbal battery and 

Part I af TIP, and that for the Lorge- Thorndike nonverbal battery 
and the total score on TIP, 



TABLE 5. z- SCORES 6 FROM TESTING FOR A SIGNIFICANT DIFFERENCE 
BETWEEN CORRESPONDING CORRELATION COEFFICIENTS IN TABLE 3 AND 
TABLE 4. 



1 



% 


LT-V 


LT-NV TIP- 1 


TIP- II 


TIP-T 


Lorge- Thorndike 
Verbal 


.00 


,42 1,03 


1.71 


1.49 


L orge- Th omdike 
Nonverbal 




.00 2.51 


1.25 


1.97 


Test of Inf, Pat, 
Part I 




.00 


1.92 


1.25 


Test af Inf, Pat, 
Part II 






.00 


1.86 


Test of Inf, Pat, 
Total 








.00 



c z > 1,96 is required for significance at the 5% level. 



Since significant treatment differences were found in the 
analyses of variance and covariance, the Test cf Inference 
Patterns was further examined to determine which patterns were 
understood by students cf various groups and to determine which 
patterns contributed to making the results significant, A student 
was said to have understood a pattern if he responded correctly to 
five or six occurrences af that pattern. The proportion af such 
students in several categories have been compiled in Table 6, 
Students were placed in the high IQ category if the sura af their 
IQ's on the verbal and nonverbal batteries cf the Lorge- Thorndike 
Intelligence Tests was greater than 220, The median IQ for the 
students in this first experiment was 110 on each battery* 
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TABLE 6. PROPORTION OF STUDENTS IN THE INDICATED CATEGORIES WHO 
RESPONDED CORRECTLY TO FIVE OR SIX EXAMPLES OF EACH INFERENCE 
PATTERN ON A TEST OF INFERENCE PATTERNS, 






Categories 


A 


B 


C 


D 


J3 

Patterns 
E F 


G 


H 


I 


J 


Experimental 


.65 


.60 


.55 


.10 


.60 


.68 


.23 


.50 


.20 


.00 


Male 


.65 


.61 


.44 


.14 


.65 


.70 


.30 


.44 


.22 


.00 


Female 


.65 


.59 


.71 


.06 


.53 


.65 


•12 


.59 


.18 


.00 


High IQ 


.80 


.75 


.70 


.15 


.75 


.80 


.30 


.60 


.25 


.00 


Low IQ 


.50 


.45 


.40 


.05 


.45 


.55 


.15 


•40 


.15 


.00 


Control 


.48 


.78 


.13 


.05 


.35 


.70 


.33 


.35 


.03 


.00 


Male 


.40 


.80 


.05 


.10 


.25 


.50 


.40 


.20 


.00 


.00 


Female 


.55 


.75 


.20 


.00 


.45 


.90 


.25 


.50 


.05 


.00 


High IQ 


.53 


.79 


.11 


.11 


.53 


.79 


.26 


.47 


.00 


.00 


Low IQ 


.43 


.76 


.14 


.00 


.19 


•62. 


.38 


.24 


.05 


.00 



Each of capital letters A through J refers to the inference 
pattern so designated in Appendix A. 



Proportions between the following categories were found to 
be significant for the indicated patterns; 

1) experimental over control on patterns C and E, 

2) experimental male over control male on patterns C and E, 

3) experimental female over control female on pattern C, 

4) control female over control male on patterns F and H^ 

5) experimental nigh IQ over control high IQ on pattern C, 

6) control lew IQ over experimental low IQ on pattern B, 

7) e^erimental high IQ over experimental low IQ on pattern A. 

8) control high IQ over control low IQ on pattern E, 

Pattern C (or-introduction) and pattern E (hypothetical 
syllogism) contributed the most to the significant difference 
between the experimental and control groins in the first 
experiment. 
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The F- rati os and estimated omegas- squared from the analyses 
of variance and covariance of the tests used in the second 
experiment have been tabulated in Table 7. The summary statistics, 
tests for homogeneity of variance, and summary tables for the 
analyses of variance and covariance which form the basis for 
nlf L/ 6 bee " placed in Appendix E, Tables 17 through 21. 

V!?L f ° r haa °9 eneit y of variance [14] revealed a 
significant difference only among the four cell variances for the 
nonverbal battery of the Lorge- Thorndike Intelligence Tests. 
However, the calculated chi-square of 8.05 represented a slight 
excess over the tabled value of 7.8 at the 5% level of signifi- 
cance. This moderate departure from the assumption of equal 
variances has been claimed not to seriously affect the sampling 
distribution of the resulting F statistic [14]. 

- 4 .i, An 5 i:LySeS n^ f variance on the verbal and nonverbal batteries 

aiff er e n«r^°ri? aike , lnt e* U 9 enee Tests yielded no significant 

intemcMn k * ke ma * n e ff ec *s °f treatment or sex and for the 
interaction between treatment and sex. 

T - . r ? S ^ ts of the analyses of variance and covariance on 

Inferential Reasoning Analysis and its subscales led to the 
rejection of the mill hypotheses of no significant difference 
between treatment means in all cases except for the analysis of 
variance on Part I of IRA. Thus, the instructional unit on 

differenL^ 0 ^" 9 -'^ 3 e££ f=? lve in producing highly significant 
differences on the inferential reasoning scale. 

Significant F-ratios were obtained for the main effect of 

t X fa ° tor ln . the following analyses of variance (AKOVA) and 
analyses of covariance (ANOCOVA): ' * 

1) ANOVA on the Part I scores of IRA, 

2) AHOCOVA on the Part 1 scores of IRA with nonverbal IQ 

as covariate, 

3) ANOVA on the Part I and II scores of IRA 

4) ANOCOVA on the Part I and II scores of IRA with nonverbal 

IQ as covariate, 

5) ANOVA on the Part III scores of IRA, 

6) ANOCOVA on the Part III scores of IRA with verbal IQ as 

covariate, 

7) ANOCOVA on the Part III scores of IRA with nonverbal IQ 

as covariate, 

8) ANOVA on IRA, 

i\\ ^S° VA ° n IRA with verbal IQ as covariate, and 
10) ANOCOVA on IRA with nonverbal IQ as covariate. 

There was no significant interaction between treatment and 
sex in the analyses of variance and covariance on Inferential 
Reasoning Analysis and its subscales. 
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7 * RATIOS AND ESTIMATED OMEGAS- SQUARED FROM THE 
ANALYSES OF VARIANCE AND OF COVARIANCE IN THE SECOND EXPERIMENT. 




LT-V 

LT-NV 

IRA- 1 
IRA- II 
IRA- MI 
IRA- II I 
IRA- IV 
IRA-T 



= Lorge-^omdike Intelligence Tests, Verbal Battery 

- Lorge- Thorndike Intelligence Tests, Nonverbal Battery 

- Inferential Reasoning Analysis, Part I 
Inferential Reasoning Analysis, Part II 

~ Inferential Reasoning Analysis, Parts I and II 

- Inferential Reasoning Analysis, Part III 

- Inferential Reasoning Analysis, Part IV 

- Inferential Reasoning Analysis, Total Test 
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The degree of association between treatment and Inferential 
Reasoning Analysis was substantial. An omega-squared of .39 was 
cbtaxned for the treatment with Part II of IRA under covariance 
a gustment for verbal IQ. Thus, the independent variable 
^treatment) has been estimated to account for 39% of the variance 
of the dependent variable (Part II of IRA) adjusted by the 
covariate (verbal IQ). As witnessed by the relative sizes of the 

beSeen S + Uar ^f ** th j treatment column, the stronger association 
between treatment and Part II accounted for much of the estimated 
indices on Parts I and II and on the total test. 

The degree of association between sex and inferential 

reasoning was small. The indices of association were observed to 

® ^ ater ° n Parts 1 or 111 than on Parts II or IV. There was 

wither « ? 9ree * associa tion for the interaction effect 
with inferential reasoning. 

omegas-squared a increased ^en'Sfvariois scTes^lL^^ 

ass isrr 

covariance adgustment for vertol IQ but increased for nonverbal 



P ° rts 1 and II of IRA wo.s determined 

37 P students in the eo ° tu ? ents in the experimental group and the 
students in the control groiq>. The reliability coefficients 

Soearman^ ^ ^ method and attenuated by the 

I^ L FOmUl ? have been P laced in Table 8 on 
tne next pcige. Since these reliability coefficients were 

sioSfi d ty P toluc t-m aoent correlation, they were tested for 
significance from zero. The reliability coefficient of 305 for 

va!u c e o r ° 2 r:r on rr “ **• sii ^ 

value of .325 required for significance f rau zero. 
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TABLE 8, SPLIT-HALF RELIABILITY COEFFICIENTS 0 FOR PARTS I AND 
II OF INFERENTIAL REASONING ANALYSIS. 



Inferential Reasoning Analysis 


Experimental 


Control 


Part I 


-75 


.60 


Part II 


.-55 


.305 


Parts I + II 


• 76 


.66 



t 



Coefficients have been attenuated by use of the Spearman-Brown 
Prophecy Formula. 



Pearson product-moment coefficients of correlation have been 
calculated separately for the treatment groups on all pairs of 
the following scales: Lorge- Thorndike Intelligence Tests, Verbal 

Battery* Lorge- Thorndike Intelligence Tests, Kcnverbal Battery'* 
IRA-Part I* IRA-Part II* IRA-Parts I and II* IRA-Part III* IRA- 
Part IV; and IRA-Total Test. The correlation coefficients for 
the experimental group have been placed in Table 9, while those 
for the control group have been placed in Table 10, 

All correlation coefficients for the experimental group were 
found to be significantly different from zero at the preassigned 
level of 5%. With respect to the control group, however, when 
Part IV of Inferential Reasoning A,nalysis was one of the scales, 
the obtained coefficients of correlation were not significantly 
different from zero. 

Inspection of the correlation coefficients for the pairwise 
comparisons of the four parts of IRA yielded a maximum coeffi- 
cient of .60 between Part I and Part III for the experimental 
group. Each of the subscales was measuring a different charac- 
teristic of the group because at most 36% of the variance of any 
part was accounted for by the variance of another. 
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TABLE 9. MATRIX OF CORRELATION COEFFICIENTS b ON THE INDICATED 
VARIABLES FOR THE EXPERIMENTAL GROUP IN THE SECOND EXPERIMENT. 




For df = 38, r > .312 is required for significance from zero at 
the 5% level. 



TABLE 10. MATRIX OF CORRELATION COEFFICIENTS 0 ON THE INDICATED 
VARIABLES FOR THE CONTROL GROUP IN THE SECOND EXPERIMENT. 





LT-NV 

► 


IRA-I IRA- II 


IRA-I+II 


IRA- III 


IRA- IV 


IRA-T 


LT-V 


• 71 


.63 .56 


.71 


.37 


1 

• 

o 

in 


.59 


LT-NV 




•65 .45 


.67 


.51 


1 

• 

to 

O 


.63 


IRA- I . 




.41 


.89 


.45 


— . 01 


.74 


IRA- II 






.77 


.38 


.ii 


.66 


IRA-I+II 








.50 


.04 




IRA- III 










.18 


.87 


IRA- IV 

\ 


i 

» 










.28 



For df = 35, r > .325 is required for significance from zero ct 
the 5% level. 
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The corresponding correlation coefficients for the treat- 
ment groups were tested for significance of difference for 
independent samples* The resulting z-scores have been placed in 
Table 11* At the 5% level the null hypothesis of no significant 
difference was rejected for Part XV of Inferential Reasoning 
Analysis paired with the following: Lorge- Thorndike verbal 

battery, Lorge- Thorndike nonverbal battery. Part I of IRA, Parts 
I and II of IRA, and total test of IRA* 



TABLE 11. z-SCORES C PROM TESTING FOR A SIGNIFICANT DIFFERENCE 
BETWEEN CORRESPONDING CORRELATION COEFFICIENTS IN TABLES 9 
AND 10. 




z > 1.96 is required for significance at the 5% level. 



Since significant treatment differences were found in the 
analyses of variance and covariance. Inferential Reasoning Analy- 
sis was further examined to determine which patterns were 
understood by students of various groins and to determine which 
patterns contributed to making the results significant. A 
student was said to have understood a pattern if he responded 
correctly to six or seven or eight occurrences of that pattern. 
The proportions of such students in several categories have been 
compiled .in Table 12. A student was placed in the high IQ 
category if the sum of his IQ f s on the verbal and nonverbal 
batteries of the Lorge- Thorndike Intelligence Tests was greater 
that 220. The median IQ for the students in this second experi- 
ment was 110 on each battery. 
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TABLE 12. PROPORTION OF STUDENTS IN THE INDICATED CATEGORIES 
WHO RESPONDED CORRECTLY TO SIX, SEVEN OR EIGHT EXAMPLES OP 
EACH VALID INFERENCE PATTERN C'N PARTS I AND II OF THE 
INFERENTIAL REASONING ANALYSIS „ 



Categories 


, A 


B 


Patterns 
C E 


d 

» 

► 

F 


G 


H 


Experimental Total 


.73 


.83 


.68 


.75 


.93 


.25 


.50 


Male 


.60 


.80 


.60 


.75 


.95 


.20 


.40 


Female 


.85 


.85 


.75 


.75 


.90 


.30 


.60 


High IQ 


.90 


.90 


.90 


.90 


1.00 


.42 


.79 


Low IQ 


.57 


.76 


.48 


.62 


.86 


.10 


.24 


Control Total 


.76 


.76 


.19 


.35 


.70 


.49 


.30 


Male 


.65 


.65 


.13 


.23 


.65 


.50 


.32 


Female 


.93 


.93 


.27 


.53 


.80 


.47 


.27 


High IQ 


.94 


.83 


.28 


.50 


.94 


.72 


.50 


Low IQ 


.58 


.68 


.11 


.21 


.47 


.26 


.11 



Each of the capital letters A through H refers to the inference 
pattern so designated in Appendix A. 



Proportions between the following categories were found to be 
significant for the indicated patterns used in Parts I and II of 
IRA: 

I) experimental over control on patterns C,E, and F, wut control 
over experimental on pattern G, 

2.) experimental males over control males on patterns C, E, and F, 
but control males over experimental males on pattern G, 

3) experimental females over control females on patterns C and H, 

4) experimental males over control females on pattern C, but 
control females over experimental males on pattern A 

5) experimental females over control males on patterns C and E, 

6) control females over control males on patterns A, B, and E, 

7' experimental high Iq over experimental la-? IQ on patterns A f 

C, G, and H, 

8) experimental high IQ over control high IQ on patterns C and E, 

9) experimental high IQ over control low IQ on patterns A, C, F«, 

F, and H, 

10) control high IQ over experimental low IQ on patterns A and G, 

II) experimental low IQ over control low IQ on patterns C,E and F, 
12.) control high IQ over control lew IQ on patterns A, F, G, and K. 
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DISCUSSION 



,! h !v 6J ^ Plin ? P rocedure employed in this investigation was 
done Without replacement and from a finite population of 157. 

2ze of°40 dU rte did T QffeCt the sara P le mea "f but £ai a sample 
fnetn^J i sample variance could have been changed by a 

and ctandard error of the mean by .86. Ho 
adgustoents were made in any statistical tests to reflect this 

however 6 analysis variance procedure, 

assumptions T? V < y r ? bUS * that moderat e departures free, its 
assumptions do not seriously affect the validity of inferences 

derived from the experimental data [4,5]. 

was ^ *“ tlon ° n the experimental aspect of this project 

the and "se Of only one person as the teacher of 

IVS i S'v adclition ' the appointed teacher was a first- 
y ar teacher and had no special preparation in logic. He was 

rf V t«2cs aS fh ' - f ^ GCti r 2£&iSSr and a suggested timetable 
man^e? t0 conduct the c °"™e in an effective 

bevond*th« 9^ idan ce was partly on purpose and partly 

beyond the control of the principal investigator. Seme 

^ Cre<3it 1 £or significant differences must be 
. to ? be Professional attitude and competence of this 

Imreciat» J;f a< H n3 hls students to understand the content and to 
appreciate the importance of effective thinking. 

intent of this project was to incorporate the 
lements af effective thinking learned in the logic course into 

ola^af'faP cl assroom setting. This would have been done had the 
ti n fnJnT ^11 SCCt ? ns for “11 courses been feasible. Due 
1° ?rwf° Ument , tha “ expacted the administration decided 

the ^ liVC sections for the regular courses and four for 

the exploratory program. Ihe assignment of students to the 
regular course sections followed the same technique as that for 

Thu S Se°, r em 0ry P™ 9 ? 0 ? oxce P t t} >at groups of five were formed. 

- gic material was learned in a separate setting with 
very few references made to situations in the regular content 
areas by the teacher af the logic course. content 

the r^lt? « d ! SiSn did not P eirait di^ct comparison of 
Wrtjewor ^ f h fir f t e:! P eriment with those of the second. 

S comparison has been made in the remaining discus- 

sion subject to possible error from these threats to invaliditv 

students'Tn ^1?^“ Ill \ ^ main history threat was that 
second of ejq>enment might have informed those in the 

„ °" d 5^ nature of the measuring instruments. This could be 

the e.??o Q d Qti0n f ° r the significant difference between sexes in 
the second experiment. Consultation with the teacher of the 

^history Sf^ ?° ""d?" 01 0CCurrences that mi 9ht contribute 
to a history effect. Regarding maturation^ Howell [6] determined 
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that eighth- grade accelerated mathematics students who had 
received no formal instruction in inference patterns understood 
one more inference pattern (and-introduction) than did their 
seventh-grad counterparts « A period of eleven weeks lapsed from 
the administration of TlP to that of IRA. 

Comparison of the control categories in Tables 6 and 12 
showed a significant difference on one pattern only, viz;., pattern 
A (and-introduction). Ibis difference could have been ca us ed by 
randomness, maturation, history, or the fact that IRA did not con- 
tain invalid patterns. Since the invalid patterns used in TIP 
involved conditions and not conjunctions, the last possibility was 
considered unplausible. The IRA experimental group gained a 
significant increase over thB TIP experimental group on two 
patterns: and- elimination (B) and rule of detachment (P) . In 

addition to the previously suggested causes of difference, previ- 
ous experience by the teacher might have aided the observed gain 
on both patterns. The absence of invalid patterns in IRA might 
have effected better performance on rule of detachment (P). In 
TIP both the rule of detachment (F) and its invalid analogue, 
converse rule (I), were presented to the students. This inclusion 
of pattern I in TIP without previous exposure -o it in the logic 
class might have caused a reduction of confidence by the experi- 
mental group in responding correctly to pattern P. 

Analysis of covariance, whether with verbal or nonverbal IQ 
as covariate, produced highly significant differences between the 
treatment groups for the Part II scores on both TIP and IRA and 
for the total scores on TIP and the Part I+II scores on IRA.. 
However the degree of association between treatment and measuring 
instruments was at least twice as great for IRA as for TIP. 

Again, confrontation with previously unencountered and unlearned 
invalid inference patterns might have caused this difference along 
with the previously discussed threats. Significant treatment 

differences were obtained on Part I of IRA but not on Part I af 
TIP. 

Bmamination of the correlations between Part I and Part II of 
TIP and between the corresponding parts of IRA revealed a maximum 
c oef ficient of .55. Therefore, these two parts measured sane 
common characteristic which accounted for at most 31% of the 
variance cf each, but they also measured different characteristics. 
No names have been attached to them at this time. A factor 
analytic study has been planned in the near future to determine 
the quantity and nature of the characteristics or factors operat- 
ing in the tests. 



